BAR4R-PUB-01/05 
SLAC-PUB-8898 



O 



O 

i-H 
> 



Measurement of the B -^ J/iJjK* (892) decay amplitudes 



The BaBAR Collaboration 



B. Aubert,^ D. Boutigny,i J.-M. Gaillard/ A. Hicheur/ Y. Karyotakis/ J. P. Lees/ P. Robbe/ V. Tisserand,^ 
A. Palano,2 G. P. Chen,^ J. C. Chen,^ N. D. Qi,^ G. Rong,^ P. Wang,^ Y. S. Zhu,^ G. Eigen,* P. L. Reinertsen,^ 

O '. B. Stugu,^ B. Abbott,^ G. S. Abrams,^ A. W. Borgland,^ A. B. Breon,^ D. N. Brown,^ J. Button-Shafer,^ 

(N ; R. N. Cahn,5 A. R. Clark,^ M. S. Gill,^ A. Gritsan,^ Y. Groysman,^ R. G. Jacobsen,^ R. W. Kadel,^ J. Kadyk,^ 

L. T. Kerth,^ S. Kluth,^ Yu. G. Kolomensky,^ J. F. Kral,^ C. LeClerc,^ M. E. Levi,^ T. Liu,^ G. Lynch,^ 
A. B. Meyer, 5 M. Momayezi,'^ P. J. Oddone,^ A. Perazzo,^ M. Pripstein,^ N. A. Roe,^ A. Romosan,^ M. T. Ronan,'^ 
V. G. Shelkov,^ A. V. Telnov,^ W. A. Wenzel,'^ P. G. Bright-Thomas, ^ T. J. Harrison,'^ C. M. Hawkes,*^ A. Kirk,^ 
CS ■ D. J. Knowles,^ S. W. O'Neale,^ R. C. Penny,^ A. T. Watson,^ N. K. Watson,^ T. Deppermann,^ K. Goetzen,'^ 

H. Koch,'^ J. Krug,'^ M. Kunze,'^ B. Lewandowski,"^ K. Peters,'^ H. Schmuecker,'^ M. Steinke,"^ J. C. Andress,^ 
N. R. Barlow,^ W. Bhimji,^ N. Chevalier,^ P. J. Clark,^ W. N. Cottingham,^ N. De Groot,* N. Dyce,* B. Foster,^ 
Q^ ! J. D. McFall,*^ D. Wallom,*^ F. F. Wilson,^ K. Abe,^ C. Hearty,^ T. S. Mattison,^ J. A. McKenna,^ D. Thiessen,^ 

'sj- ; S. Jolly,!" ^^ j^^ McKemey,!" J. Tinslay,i" V. E. Blinov," A. D. Bukin," D. A. Bukin," A. R. Buzykaev," 

^ ! V. B. Golubev," V. N. Ivanchenko," A. A. Korol," E. A. Kravchenko," A. P. Onuchin," A. A. Salnikov," 

^ ; S. I. Serednyakov," Yu. I. Skovpen," V. L Telnov," A. N. Yushkov," D. Best,!^ A. J. Lankford,!^ 

T-H ■ M. Mandelkern,i2 g McMahon,!^ D. P. Stoker, ^^ a. Ahsan,!^ ^^ Arisaka,^^ C. Buchanan, ^^ g^ Chun,!^ 

O ; J. G. Branson,i4 D. B. MacFarlane,i4 S. Prell,!'' Sh. Rahatlou,!^ G. Raven,!" V. Sharma,!" C. Canipagnari,!^ 

X ; B. Dahmes,!^ P. A. Hart,i^ N. Kuznetsova,!^ S. L. Levy,!^ q Long,!^ A. Lu,!^ J. D. Richman,!^ W. Verkerke,!^ 

^ '■ M. Witherell,!^ S. Yellin,!^ J. Beringer,!^ D. E. Dorfan,!^ A. M. Eisner,!^ A. Frey,i^ A. A. Grillo,!^ M. Grothe,!*^ 
Ph! C. a. Heusch,i6 R. p. Johnson,i6 W. Kroeger,!^ W. S. Lockinan,!^ T. PuUiam,!^ H. Sadrozinski,!^ T. Schalk,!^ 

^ ■ R. E. Schmitz,i6 B. A. Schumm,!^ A. Seiden,!^ M. Turri,!*' W. Walkowiak,!^ D. C. Williams,!^ M. G. Wilson,!^^ 

• • ! E. Chen,!^ G. P. Dubois-Felsmann,i^ A. Dvoretskii,!^ D. G. Hitlin," S. Metzler," J. Oyang,i^ F. C. Porter,i^ 

.^ ; A. Ryd,i^ A. Samuel,!^ M. Weaver,i^ S. Yang,i^ R. Y. Zhu,i^ S. Devmal,!^ T. L. Geld,i* S. Jayatilleke,!^ 

^ ■ G. MancineUi,!^ B. T. Meadows,!^ M. D. Sokoloff,i® T. Barillari,!^ P. Bloom,!^ M. O. Dima,!^ S. Fahey,!^ 

H ! W. T. Ford,i9 D. R. Johnson,!^ U. Nauenberg,!^ A. Olivas,!^ H. Park,!^ P. Rankin,!^ J. Roy,!^ S. Sen,!^ 

J. G. Smith,i9 W. C. van Hoek,!^ D. L. Wagner,!^ J. Blouw,20 J. L. Harton,20 M. Krishnamurthy,20 A. Soffer,^^ 

W. H. Toki,2" R. J. Wilson,2" J. Zhang,^^ T. Brandt,^! J. Brose,^! T. Colberg,^! G. Dahlinger,^! M. Dickopp,^! 

R. S. Dubitzky,2i E. Maly,^! R. Muller-Pfefferkorn,^! S. Otto,^! K. R. Schubert,^! R. Schwierz,^! B. Spaan,^! 

L. Wilden,2i L. Behr,^^ D. Bernard,^^ G. R. Bonneaud,^^ F. Brochard,22 J. Cohen-Tanugi,^^ S. Ferrag,22 

E. Roussot,^^ S. T'Jampens,^^ C. Thiebaux,^^ G. Vasileiadis,^^ M. Verderi,^^ A. Anjomshoaa,^^ R. Bernet,^^ 

A. Khan,23 F. Muheim,23 S. Playfer,23 J. E. Swain,23 M. Falbo,24 C. Borean,^^ C. Bozzi,^^ S. Dittongo,^^ 

M. Folegani,^^ L. Piemontese,^^ E. Treadwell,^*" F. AnuUi,^'^' * R. Baldini-FerroH,^'^ A. Calcaterra,^"^ R. de Sangro,^'^ 

D. Falciai,27 G. Finocchiaro,^^ P. Patteri,^^ I. M. Peruzzi,^^. * M. Piccolo,^^ Y. Xie,^^ A. Zallo,^'^ S. Bagnasco,^^ 

A. Buzzo,^* R. Contri,28 G. Crosetti,^^ P. Fabbricatore,^^ S. Farinon,^^ M. Lo Vetere,^^ M. Maori, ^^ M. R. Monge,^^ 

R. Musenich,28 M. Pallavicim,^^ R. Parodi,^^ S. Passaggio,^^ F. C. Pastore,^^ C. Patrignani,^* M. G. Pia,^* 

C. Priano,28 E. Robutti,^^ A. Santrom,^^ M. Morii,^^ R. Bartoldus,^" T. Dignan,30 R. Hamilton,30 U. Mallik,^^ 
J. Cochran,3i H. B. Crawley, ^i P.-A. Fischer, ^^ J. Lamsa,^! W. T. Meyer, ^i E. I. Rosenberg, ^i M. Benkebil,^^ 

G. Grosdidier,32 C. Hast,32 A. Hocker,^^ H. M. Lacker,^^ V. LePeltier,32 A. M. Lutz,^^ S. Plaszczynski,32 

M. H. Schune,32 S. Trincaz-Duvoid,^^ A. Valassi,^^ G. Wormser,^^ R. M. Bionta,^^ V. Brigljevic,^^ D. J. Lange,^^ 

M. Mugge,33 X. Shi,33 K. van Bibber,33 T. J. Wenaus,33 D. M. Wright,33 C. R. Wuest,33 M. Carroll,34 J. R. Fry,34 

E. Gabathuler,34 R. Gamet,34 M. George,34 M. Kay,34 D. J. Payne,34 R. J. Sloane,34 C. Touramanis,34 



M. L. Aspinwall,^^ D. A. Bowerman,^^ P. D. Dauncey,^^ U. Egede,^^ I. Eschrich,^^ N. J. W. Gunawardane,^^ 

J. A. Nash,35 P. Sanders,35 D. Smith,^^ D. E. Azzopardi,^^ J. J. Back.^^ P. Dixoii,^^ p. F. Harrison,^^ 

R. J. L. Potter,36 H. W. Shorthouse,^^ P. Strother,^^ p. B. Vidal,^^ M. I. Williams.^e G. Cowan,^^ S. George,^^ 

M. G. Green,37 A. Kurup,^^ C. E. Marker,^^ p. McGrath,^^ T. R. McMahoii,^^ S. Ricciardi,^^ F. Salvatore,^^ 

I. Scott,37 G. Vaitsas,37 D. Brown,^* C. L. Davis,^^ J. Allison,^^ R. J. Barlow,^^ J. T. Boyd,^^ A. C. Forti,39 

J. Fullwood,39 F. Jacksoii,39 G. D. LafFerty,^^ N. Savvas,^^ E. T. Simopoulos,^^ J. H. Weatherall,^^ A. Farbin,40 

A. Jawahery,40 V. Lillard,40 J. Olsen,^" D. A. Roberts,40 J. R. Schieck,^" G. Blaylock,^! C. Dallapiccola,^! 

K. T. Flood,-*! S. S. Hertzbach,4i R. Kofler,"*! T. B. Moore,^! H. Staengle,^! S. Willocq,*! B. Brau,*^ R. Cowan,'*2 

G. Sciolla,'^^ p^ Taylor,42 R. K. Yamamoto,42 M. Milek,*^ p. M. Patel,*^ j^ Trischuk,*^ F. Lanni,^^ F. Palombo,'*'* 

J. M. Bauer,'*5 M. Bookc,'*^ L. Crenialdi,^^ V. Eschenburg,'*^ R. Kroeger,''^ J. Reidy,''^ D. A. Sanders,''^ 

D. J. Summers,''^ J. P. Martin,^^ J. Y. Nief,^^ R. Seitz,*^ p. Taras,^^ A. Woch,46 V. Zacck,^^ H. Nicholson,*^ 

C. S. Sutton,47 C. Cartaro,48 N. Cavallo,^^. t G. De Nardo,*^ F. Fabozzi,*^ C. Gatto,*^ L. Lista,^^ P. Paolucci.^^ 

D. Piccolo,^^ C. Sciacca,''^ J. M. LoSecco,^^ J. R. G. AlsmiUer,'™ T. A. Gabriel,5° T. Handler,50 J. Brau,'^! R. Frey,'^! 

M. Iwasaki,5i N. B. Sinev,^! D. Strom,''^i F. Colecchia,^^ p pj^i Corso,^^ a. Dorigo,^^ p Galeazzi,^^ M. Margoni,^^ 

G. Michelon,52 ^^ Morandin,^^ ^^ Posocco,^^ ^^ Rotondo,^^ p^ Simonetto,^^ ^ Stroili,^^ E. Torassa,^^ (j Voci,^^ 

M. Benayoun,^^ H. Briand,^^ J. Chauveau,^^ P. David, ^^ C. De la Vaissiere,^^ L. Del Buono,^^ O. Hamon,^^ 

F. Le Diberder,53 p^^ Lcruste,^^ j^ Lory,^^ p. Roos,^^ j^ Stark,^^ S. Versille,^^ p^ p^ Manfredi,^'' V. Re,^^ 
V. Speziali,5'* E. D. Frank,^^ L. Gladney,^^ Q. H. Guo,^^ J. H. Panetta,^^ C. Angelini,^^ G. Batignani,''^^ 

S. Bettarim,56 M. Bondioli,^^ M. Carpinelli,^^ p porti,^^ m. A. Giorgi,^^ A. Lusiani,^^ F. Martinez- Vidal,^^ 

M. Morganti,^^ N. Neri,^^ E. Paoloni,^'^ M. Rama,^^ G. Rizzo,^'^ F. Sandrelli,^'^ G. Simi,^^ G. Triggiam,^^ 

J. Walsh,^^ M. Haire," D. Judd," K. Paick,^^ L. Turnbull," D. E. Wagoner,'^^ J. Albert,^* C. Bula,^* P. Elmer,^^ 

C. Lu,5« K. T. McDonald,58 V. Miftakov,^^ g^ p^ SchafFner,^^ ^ j g Smith,^^ A. Tumanov,^^ E. W. Varnes,^^ 

G. Cavoto,^^ D. del Re,^^ R. Faccini,*'*'^^ F. Ferrarotto,'''^ F. Ferroni,^^ K. Fratini,^^ E. Lamanna,^^ 

E. Leonardi,^^ M. A. Mazzoni,^'^ S. Morganti,^^ G. Piredda,^^ F. Safai Tehrani,^^ M. Serra,^^ C. Voena,^'^ 

S. Christ,60 R. Waldi,60 P. F. Jacques,^! M. Kalelkar,^! R. J. Plano,^! T. Adye,62 B. Franek,62 N. I. Geddes,62 

G. P. Gopal,62 g^ ^^ Xella,62 R. Aleksan,63 G. De Domenico,63 S. Emery,63 A. Gaidot,^^ S. F. Ganzhur,63 
P.-F. Giraud,^3 q Hamel de Monchenault,'53 -y^^ Kozanecki,*^3 y[^ Langer,S3 q ^^ London,'53 B. Mayer, ^3 

B. Serfass,63 G. Vasseur,63 C. Yeche,63 M. Zito,63 N. Copty,64 ^^ y^ Purohit,^^ H. Singli,^^ p ^ Yumiceva,^^ 

I. Adam,S5 p p. Antliony,^^ D. Aston,^^ K. Baird,^^ E. Bloom,^^ a. M. Boyarski,^^ F. Bulos,^^ G. Caldcrini,^^ 

R. Claus,*^^ M. R. Convery,^^ D. P. Coupal,^^ D. H. Coward,^^ j Dorfan,^^ M. Doser,^^ W. Dunwoodie,'^^ 

R. C. Field,65 T. Glanzman,65 G. L. Godfrey,^^ S. J. Gowdy,^^ p. Grosso,^^ T. Himel,^^ M. E. HufFer,^^ 

W. R. Inncs,^''^ C. P. Jessop,^^ M. H. Kelsey,^^ p. Kim,^^ M. L. Kocian,^^ U. Langenegger,^^ D. W. G. S. Lcith,^^ 

S. Luitz,65 V. Luth,65 H. L. Lynch,^^ H. Marsiske,^^ S. Menke,^^ R. Messner,^^ K. C. Moffeit,^^ j^^ Mount,^^ 

D. R. Muller,65 C. P. O'Grady,^^ M. Perl,^^ S. Petrak,^^ H. Quinn,^^ B. N. RatclifF,^^ S. H. Robertson,^^ 

L. S. Rochester,S5 j^ Roodman,^^ T. Schietinger,^^ R. H. Schindler,^^ J. Schwiening,^^ y. V. Serbo,^^ A. Snyder,^^ 

A. Soha,^''^ S. M. Spanier,^^ J. Stelzer,^^ D. Su,^^ M. K. Sullivan,^^ H. A. Tanaka,'^^ J. Va'vra,^^ S. R. Wagner,^^ 

A. J. R. Weinstein,65 W. J. Wisniewski,^^ D. H. Wright,^^ C. C. Young,^^ P. R. Burchat,^^ C. H. Cheng,66 

D. Kirkby,66 T. I. Meyer,^^ C. Roat,^^ R. Henderson,^^ W. Bugg,^^ H. Cohn,^* A. W. Weidemann,^^ J. M. Izen,^^ 

I. Kitayama,S9 X. C. Lou,^'^ M. Turcotte,^^ F. Bianchi,™ M. Bona,™ B. Di Girolamo,™ D. Gamba,™ A. Smol,™ 

D. Zanin,™ L. Lanceri,^* A. Pompili,'^^ G. Vuagnin,'^^ R. S. Panvini,'^2 q ]y[ Brown,'^3 j^ p)g giiva,'^3 

R. Kowalewski,''3 J. M. Roney,'^3 ^ ^ Band,'^'^ E. Charles,^"* S. Dasu,^"* F. Di Lodovico,'^'^ A. M. Eichcnbaum,^'* 

H. Hu,74 J j^ Jolinson,^4 j^^ piu,^'' J. Nielsen,^" Y. Pan,^" R. Prepost,^'' I. J. Scott, ^^ g j gckula,^" 

J. H. von Wimmcrspcrg-Toellcr,'^'* S. L. Wu,'^'' Z. Yu,^"* H. Zobernig,'^'* T. M. B. Kordich,'^-'^ and H. Neal'^^ 

^Laboratoire de Physique des Particules, F-7494i Annecy-le-Vteux, France 

^ Universita di Bari, Dipartimento di Fisica and INFN, 1-70126 Bari, Italy 

'^Institute of High Energy Physics, Beijing 100039, China 

* University of Bergen, Inst, of Physics, N-5007 Bergen, Norway 

^Lawrence Berkeley National Laboratory and University of California, Berkeley, CA 94720, USA 

^ University of Birmingham, Birmingham, B15 2TT, United Kingdom 

^ Ruhr Universitdt Bochum, Institut fiir Experimentalphysik 1, D-44^80 Bochum, Germany 

* University of Bristol, Bristol BS8 1 TL, United Kingdom 

^ University of British Columbia, Vancouver, BC, Canada V6T IZl 

^^ Brunei University, Uxbridge, Middlesex UBS 3PH, United Kingdom 



11 



13 



Budker Institute of Nuclear Physics, Novosibirsk 630090, Russia 
University of California at Irvine, Irvine, CA 92697, USA 
University of California at Los Angeles, Los Angeles, CA 90024, USA 
^"^ University of California at San Diego, La Jolla, CA 92093, USA 



^^ University of California at Santa Barbara, Santa Barbara, CA 93106, USA 

^^ University of California at Santa Cruz, Institute for Particle Physics, Santa Cruz, CA 95064, USA 

^^ California Institute of Technology, Pasadena, CA 91125, USA 

^^ University of Cincinnati, Cincinnati, OH 45221, USA 

^"^ University of Colorado, Boulder, CO 80309, USA 

'^'^ Colorado State University, Fort Collins, CO 80523, USA 

^^ Technische Universitat Dresden, Institut fiir Kern- und Teilchenphysik, D-01062, Dresden, Cermany 

^^Ecole Polytechnique, F-91128 Palaiseau, France 

^^ University of Edinburgh, Edinburgh EH9 3JZ, United Kingdom 

^*Elon College, Elon College, NC 27244-2010, USA 

'^^ Universitd di Ferrara, Dipartimento di Fisica and INFN, 1-44100 Ferrara, Italy 1-44100 Ferrara, Italy 

'^'^ Florida A&M University, Tallahassee, FL 32307, USA 

^"^ Laboratori Nazionali di Frascati dellTNFN, 1-00044 Frascati, Italy 

^® Universitd di Genova, Dipartimento di Fisica and INFN, I-I6I46 Genova, Italy 

^^ Harvard University, Cambridge, MA 02138, USA 

^° University of Iowa, Iowa City, lA 52242, USA 

^^lowa State University, Ames, I A 50011-3160, USA 

Laboratoire de I'Accelerateur Lineaire, F-91898 Orsay, France 

'^'^ Lawrence Livermore National Laboratory, Livermore, CA 94550, USA 

^"^ University of Liverpool, Liverpool L69 3BX, United Kingdom 

^^ University of London, Imperial College, London, SW7 2BW, United Kingdom 

'^^ Queen Mary, University of London, El 4NS, United Kingdom 

University of London, Royal Holloway and Bedford New College, Egham, Surrey TW20 OEX, United Kingdom 

^® University of Louisville, Louisville, KY 40292, USA 

University of Manchester, Manchester M13 9PL, United Kingdom 

■'O University of Maryland, College Park, MD 20742, USA 

■*^ University of Massachusetts, Amherst, MA 01003, USA 

*^ Massachusetts Institute of Technology, Lab for Nuclear Science, Cambridge, MA 02139, USA 

*^McGill University, Montreal, Canada QC H3A 2T8 

Universitd di Milano, Dipartimento di Fisica and INFN, 1-20133 Milano, Italy 

'^^ University of Mississippi, University, MS 38677, USA 

Universite de Montreal, Laboratoire Rene J. A. Levesque, Montreal, Canada QC H3C 3J7 

^"^ Mount Holyoke College, South Hadley, MA 01075, USA 

■** Universitd di Napoli Federico II, Dipartimento di Scienze Fisiche and INFN, 1-80126, Napoli, Italy 

'^'^ University of Notre Dame, Notre Dame, IN 46556, USA 

^°Oak Ridge National Laboratory, Oak Ridge, TN 37831, USA 

'^^ University of Oregon, Eugene, OR 97403, USA 

^^ Universitd di Padova, Dipartimento di Fisica and INFN, 1-35131 Padova, Italy 

^^ Univer sites Paris VI et VII, LPNHE, F-75252 Paris, France 

^"^ Universitd di Pavia, Dipartimento di Elettronica and INFN, 1-27100 Pavia, Italy 

"'"' University of Pennsylvania, Philadelphia, PA 19104, USA 

^''Universitd di Pisa, Scuola Normale Superiore and INFN, 1-56010 Pisa, Italy 

^''Prairie View A&M University, Prairie View, TX 77446, USA 

^^ Princeton University, Princeton, NJ 08544, USA 

^'^ Universitd di Roma La Sapienza, Dipartimento di Fisica and INFN, 1-00185 Roma, Italy 

^^''Universitat Rostock, D-18051 Rostock, Germany 

'^^ Rutgers University, New Brunswick, NJ 08903, USA 

^^ Rutherford Appleton Laboratory, Chilton, Didcot, Oxon, 0X11 OQX, United Kingdom 

^^DAPNIA, Commissariat a I'Energie Atomique/Saclay, F-91191 Gif-sur-Yvette, France 

•"* University of South Carolina, Columbia, SC 29208, USA 

^^ Stanford Linear Accelerator Center, Stanford, CA 94309, USA 

^'^ Stanford University, Stanford, CA 94305-4060, USA 

^''TRIUMF, Vancouver, BC, Canada V6T 2A3 

•^^ University of Tennessee, Knoxville, TN 37996, USA 

^^ University of Texas at Dallas, Richardson, TX 75083, USA 

"^^ Universitd di Torino, Dipartimento di Fisica Sperimentale and INFN, 1-10125 Torino, Italy 

"^^ Universitd di Trieste, Dipartimento di Fisica and INFN, 1-34127 Trieste, Italy 

^^ Vanderbilt University, Nashville, TN 37235, USA 

""^^ University of Victoria, Victoria, BC, Canada V8W 3P6 

^■^ University of Wisconsin, Madison, WI 53706, USA 



^^Yale University, New Haven, CT 06511, USA 

(Dated: February 7, 2008) 
We present a measurement of the decay amplitudes in B ^ J/tpK*{892) channels using 
20.7 fb"^ of data collected at the r(4S') resonance with the BABAR detector at PEP-II. We 
measure a P-wave fraction R± — (16.0 ± 3.2 ± 1.4)% and a longitudinal polarization fraction 
(59.7 ± 2.8 ± 2.4)%. The measurement of a relative phase that is neither nor n, (f)^^ = 
2.50 ± 0.20 ± 0.08 radians, favors a departure from the factorization hypothesis. Although the 
decay B -^ J/tpKn proceeds mainly via K*{892), there is also evidence for 7^2(1430) and Kn 
S'-wave contributions. 

PACS numbers: 12.15.Hh, ll.30.Er, 13.25.Hw 



The decay B° -^ J/il}K*° with K*^ -^ K°ti° allows a 
measurement of the CP violation parameter sin2/3 that is 
theoretically as clean as for B^ -^ J/tpK^ [Q. However, 
due to the presence of even {L = 0, 2) and odd (L = 1) 
orbital angular momenta in the J/ip K* system, there 
can be CP-even and CP-odd contributions to the decay 
rate. If the information contained in the decay angles is 
ignored, the measured time-dependent CP asymmetry is 
reduced by the dilution factor D± = 1 — 2P^ , where R± 
is the fraction of P-wave. If the angular information is 
used, the CP components can be separated g] . 

The angular analysis also provides a test of the fac- 
torization hypothesis, the validity of which is in ques- 
tion for color-suppressed modes [|| Q|. In this scheme, 
the weak decay is described by a product of J/ip and B 
— > K* hadronic currents, and final state interactions are 
neglected. If factorization holds, the decay amplitudes 
should have relative phase or tt. 

The decay B -^ J/ipK*{892) is described by three am- 
plitudes. In the transversity basis M, m used by CLEO 
[|| and CDF 0, the amplitudes A||, Aq and A± have CP 
eigenvalues -1-1,-1-1 and —1, respectively. Aq corresponds 
to longitudinal polarization, and A|| and A± respectively 
to parallel and perpendicular transverse polarizations, of 
the vector mesons; R± is defined as |^_Lp. For a A J — 
transition, all K* -^ Kt: channels involve the same am- 
plitudes, and so the data for different decay modes can 
be combined. 

The transversity frame is defined in the J/^p rest frame. 
The K* direction defines the negative x axis. The Ktt 
decay plane defines the {x,y) plane, with y such that 
Py{K) > 0. The z axis is the normal to this plane, 
and the coordinate system is right-handed. The transver- 
sity angles 0tr and 4>tr sue defined as the polar and az- 
imuthal angles of the positive lepton from J/ip decay; 
Ok' is the K* helicity angle defined as the angle between 
the K direction and the direction opposite the J/ip in 
the K* rest frame. The normalized angular distribution 
g{cos 9 tr, cos 9 K'-,4>tr) is 



with 
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d^r 



FdcOS^tr dC0s6'i<-. Acjitr 
- /l-|AoP+/2-|A|||2 + /3 
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9/(327r) • 2 cos^ 6'k. (1 - sin^ 9tr cos^ </)t^), 
9/(327r) • sin^ 9k-' (1 - sin^ 9tr sin^ ,/)t^), 
9/(327r)- sm'^9K'Sm'^9tr, 
9/(327r) • sin^ 9ic sin 26*4^ sin (f>tr • C, 
9/(327r) • I/V2 ■ 8[n29K- sin^ 9trSin2(j)tr, 
9/(327r) • l/\/2 • sin 29k'- sin 26*4^ cos 0*^ • C- 
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When the final state is not a CP eigenstate, C is +1 
for B+ and P", and -1 for P" and P". For the CP 
mode K^TT^, C{B") = -C(-B") = 1/(1 + x^), where 
Xd = AmB^/^B^ ^ 0.73; however, since flavor is not 
determined in the present analysis, C averages to zero for 
this mode. We define the relative phases of the ampli- 
tudes as (l)± — a,rg{A±/Ao) and <j)\\ — arg(A||/Ao). 

In this letter, we present a measurement of the de- 
cay amplitudes in the decays B'^ -^ J/tpK*'^ and P"*" -^ 
J/ipK*^, where the K*'^ and K*'^ are reconstructed in 



the modes K'^tt'^ 



K+TT 

; Only J/ip decays to e+e 



and K'^^TT^ 



K^ 



and /i /J. 



Im(ASAj 



tt'^, respectively 
are considered. 
The data sample corresponds to 20.7 fb""'^ collected at 
the Y{AS) in 1999-2000 with the BABAR detector at the 
PEP-II asymmetric P Factory, and contains ~ 22.7 x 10® 
P meson pairs. 

The BABAR detector is described elsewhere [g. 
Charged particle track parameters are obtained from 
measurements in a 5-layer double-sided silicon vertex 
tracker and a 40-layer drift chamber located in a 1.5- 
T magnetic field; both devices provide dP/d.x informa- 
tion. Additional charged particle identification (PID) in- 
formation is obtained from a detector of internally re- 
fiected Cherenkov light (DIRC) consisting of quartz bars 
that carry the light to a volume filled with water, and 
equipped with 10752 photomultiplier tubes. Electromag- 
netic showers are measured in a calorimeter (EMC) con- 
sisting of 6580 CsI(Tl) crystals. An instrumented flux 
return (IFR), containing multiple layers of resistive plate 
chambers, provides /i identification. 

Electrons are identified by requiring that shower shape 
and energy deposition in the EMC be compatible with 
those expected for an electron of the measured momen- 
tum; AE /dx measurements must also be compatible with 
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FIG. 1: Beam-energy substituted mass spectra for the four 
Kn modes. The curves are from fits using the G'(mEs) and 
F{mEs) functions described in the text. 



the electron hypothesis. Muon candidates must pene- 
trate at least two interaction lengths in the detector, and 
generate a small number of hits per layer in the IFR. If 
a muon candidate traverses the EMC, its energy deposi- 
tion must be consistent with that of a minimum ionizing 
particle. Kaon candidates must survive a pion veto based 
on DIRC and dE/dx information. 

Charged tracks are required to be in regions of po- 
lar angle for which the PID efficiency is well-measured. 
For electrons, muons and kaons the acceptable ranges are 
0.41 to 2.41, 0.3 to 2.7 and 0.45 to 2.5 rad, respectively. 
J/tp candidates consist of a pair of identified leptons that 
form a good vertex. The lepton pair invariant mass must 
be between 3.06 and 3.14 GeV/c^ for muons and 2.95 and 
3.14GeV/c^ for electrons. This corresponds to a ±3(7 in- 
terval for muons, and accounts for the radiative tail due 
to bremsstrahlung for electrons. K';^ candidates consist of 
vertexed pairs of oppositely-charged tracks with invariant 
mass between 489 and 507 MeV/c^ . In the plane perpen- 
dicular to the beam line, the K]^ flight length must be 
greater than 1 mm, and its direction must form an angle 
with the K'^ momentum vector in this plane that is less 
than 0.2 rad. A photon is defined as a neutral cluster of 
energy greater than 30 MeV in the EMC that agrees in 
lateral shower shape with an electromagnetic shower. A 
TT*^ candidate consists of a pair of photons with invariant 
mass in the interval 106 to 153 MeV/c^. The J/ip , K° and 
TT^ are constrained to the corresponding nominal masses 
pU . K* candidates must have Ktt invariant mass within 
lOOMeV/c^ of the nominal K*{892) mass ^. 

B mesons are fornred from Jf-ip and K* candidates. For 
B -^ J/iP{Ktt'^)*, cosOk" is required to be smaller than 
0.667. This reduces the cross feed (CF) from J/iP{Kti^)* 



modes, where the tt^ is lost, and the self cross feed (SCF) 
due to a wrongly reconstructed 7r°. The (S)CF is the 
most important background source since it tends to peak 
in the signal region. 

The signal region is defined using two variables. The 
first is the difference A_E = Eg — E^^^^^ between the 
candidate B energy and the beam energy, in the T(45) 
rest frame. The second is the beam-energy substituted 
mass Toes — (^Lp ~ PbY^^ where, in the laboratory 
frame, E^xp — (s/2 -\-pB-Pi) / Ei is the B candidate ex- 
pected energy, ps its measured momentum, and {Ei,pi) 
the e+e^ initial state four-momentum, y/s is the center 
of mass energy. For the signal region, /S.E is required to 
be between —70 MeV and -1-50 MeV for channels involving 
a 7r°, and within ±30 MeV otherwise. If several B candi- 
dates are found in an event, the one having the smallest 
|A_E| is retained. The corresponding toes distributions 
are shown in Fig. |lj. 

With the signal region defined by toes > 5.27GeV/c^ 
and the above A_E ranges, the B reconstruction efficien- 
cies are 9.9%, 23.9%, 17.2% and 13.8% for the K^ tt", 
K'^n~ , K2; 7r+ and T^+tt" modes, respectively, with cor- 
responding total yields of 43, 547, 135 and 216 events. 
The CF(SCF) contamination levels, obtained from a full 
simulation of the BABM detector, are 9.9(15.8), 1.2(2.4), 
2.4(3.0) and 8.1(15.7)% of the pure signal, respectively. 

The fit maximizes an unbinned likelihood that uses a 
probability density function {pdf) that depends on angu- 
lar and Toes information. From the observed to.es value, 
a signal probability is computed with a Gaussian G(toes) 
to describe the signal and a phase-space background func- 
tion P F(toes). 



The pdf gobs 



g{LOj) ■ e(ujj)/{e) is used to de- 



scribe signal events; ujj represents the angular vari- 
ables cos 9tn cos 6 K * ,(t>tr for event j, and e(a3j) is the 
efficiency at l3j. Rewriting Eq. [l| as g = X]i=i /j-^jj 
where the Ai{i = 1, . . . ,6) represent l^opj I^IlP' I^J-Pj 
lin{AT.Aj^), Re(^oA||) and It[i{AqA±), the mean effi- 
ciency is (e) ~ J g ■ € ■ duj = 'l2i=i^i^i^ where the 
^i ^ J fi ■ t' duj are constants. The signal part of the log- 
likehhood, InCsignai 



^N, 



I]j=f ln(5obs(wj)), where Nobs 
is the number of observed events, becomes In Csig^ai = 

Ef=t ln(5(^,)) + Ef=t He{^j))-NobsMj:liMi)- 
Since the e{ujj) are constants, the second term can be dis- 
carded. Only the coefficients ^i are required, and detailed 
representation of the acceptance is unnecessary iQ . 

The coefficients £,i are evaluated with Monte Carlo sim- 
ulation. Separate sets of ^^ are used for each channel, and 
for £ — e,fi. The values of £,i{i — 1, 2, 3) are close to that 
of (e); ^1 is always smallest, especially in channels involv- 
ing a 7r°, because of the cut on cos Ok*- The values of 
^i{i = 4, 5, 6), which are related to the interference terms, 
are compatible with zero. 

The angular dependence of combinatorial background 
events, g^'"', is described by a pdf similar to that in Eq. |l| 



with amplitudes Bi, j = 0, |1, _L, and corresponding terms 

The angular distribution of the (S)CF background is 
amplitude dependent. We correct for the effect of this 
background by evaluating modified values ^i of the £,i by 
including the (S)CF events, in the toes signal region, in 
addition to the signal pSJ. In contrast to the ^i, the ^i 
depend on the amplitudes used in the simulation, but the 
maximum effect on the fitted amplitudes is found to be 
on the order of 10"'^. The complete log-likelihood is 

Ar„h, 



InC = ^ In I X ■ G(toesj) • gi^Jj) 



(1 -x) ■ F{mESj) ■ 9b{^]) 




{x■A^ + {l~x)■Bi)\-N , 



where x is the fraction of signal integrated over the 
Toes range 5.2-5.3 GeV/c^. The normalization of 
g and qb is relaxed in an extended likelihood ap- 
proach [|ll| , with convergence to the required condition 
a^ = 1^0 P + 1^11 P + |^_Lp = 1 imposed through the addi- 
tional term A/" = Nobso^ while \Bo\'^ + \B\\\'^ + \B±_\'^ = a^ 
holds by construction. The fit parameters are the 
mean and width of G(to.es); the shape parameter of 
^('TiEs); the fraction x; the signal amplitudes and phases 
\A\\\^ , \Aq\^, I^J-Pi 0i; and 0j|; and the corresponding 
background amplitudes and phases. 

The agreement among the results for the individual 
decay channels is shown in Table | while the fit result 
for the combined samples is summarized in Table n. In 
Fig. g, the result of the fit to the combined data is com- 
pared to the observed angular distributions. As a check 
of the fit quality, Monte Carlo samples were created with 
the observed angular distribution and number of events. 
Subsequent fits gave log-likelihood values in agreement 
with that obtained for the data. 



TABLE I: Fitted parameter values for the individual Kn 
modes. The uncertainties are statistical only. 



Quantity 




A'+TT- 


kU^ 


i^+Tr" 


|A,|^ 


0.65±0.13 


0.60±0.04 


0.58±0.07 


0.55±0.06 


\AA' 


0.07±0.11 


0.17±0.05 


0.17±0.05 


0.15±0.08 


l^lll' 


0.28±0.14 


0.23±0.05 


0.25±0.07 


0.30±0.08 


(j)i_ (rad) 


- 


-0.1 ±0.2 


0.0±0.3 


-0.4 ±0.4 


<^ll(rad) 


2.1±0.7 


2.5±0.3 


2.8±0.4 


2.6±0.5 
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FIG. 2: The angular distributions for the channels with- 
out (top) and with (bottom) a tt^' for m-ES > 5.27 GeV/c^ . 
The data have been background-subtracted and acceptance- 
corrected. The curves correspond to the fit. 



TABLE IL Fitted parameter values for the combined data 
samples. The first uncertainty is statistical, the second sys- 
tematic. Note that ((^x,0||) —> {n — (j)±, —4>\\) is also a solu- 
tion. 



Quantity 




Value 




l^ol' 
\A±f 
\A,f 


0.597 
0.160 
0.243 


± 0.028 
± 0.032 
± 0.034 


± 0.024 
± 0.014 
± 0.017 


<^±(rad) 
<^ll(rad) 


-0.17 
2.50 


± 0.16 
± 0.20 


± 0.07 
± 0.08 



F{mEs) function. Differences between simulated track- 
ing and PID efficiencies and measurements obtained with 
control samples in data lead to systematic uncertainties 
(third row) through their impact on acceptance correc- 
tions. 

The Kt: 5-wave systematic uncertainty (fourth row) is 
obtained as follows. Although the Ktt mass distribution 
for B -^ J/ipKn is dominated by the K*{892) (Fig. |(a)), 
a significant number of candidates are at higher mass 
with a clear peak at ~ 1.4GeV/c^. The states in this 
region that couple strongly to ATtt are the A'g(1430) and 
the A:2*(1430) [|10). Since it has width - 300MeV/c2, 
the ArQ(1430) alone would yield significantly more events 
above and below the peak than are observed. The 



Systematic uncertainties are detailed in Table ETI. 
Limited simulation statistics (32k events per mode) give 
rise to a systematic uncertainty in the acceptance and 
(S)CF corrections (first row). Monte Carlo simulation 
has been used to estimate uncertainties due to the as- 
sumed form for the to-es and angular distributions of the 
background (second row). In particular, this accounts for 
any possible absorption of the S(CF) background by the 



TABLE III: Systematic uncertainties described in the text. 





!^ol' 


|Ax^ 


1^11 1^ 't>± <t>\\ 


Simulation stat. 
Backgrounds 
Tracking and PID 
Ktt S-wave 


0.006 
0.002 
0.002 
0.023 


0.006 
0.005 
0.006 
0.010 


0.007 0.04 0.06 
0.006 0.06 0.05 
0.004 0.00 0.02 
0.014 0.02 0.02 


Total 


0.024 


0.014 


0.017 0.07 0.08 
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FIG. 3: (a) The background-subtracted K-k mass distribu- 
tion for the K^-K~ channel. The fit is to Breit-Wigner line- 
shapes having nominal if* (892) and A"2(f430) parameters 
[hol and a second-order polynomial (dotted line), (b) Zoom of 
the 1-1.6 GeV/c^ region of (a); the dashed curve denotes the 
sum of the Breit-Wigner contributions, (c) The background- 
subtracted Jjil) helicity cosine distribution for events with 
"tt") < 1.3GeV/c^; the curve represents the fit 



1.1 < ra(K 
of a sin^(6' 



,7/1/. 



distribution to the data. 



i4r|(1430) alone describes the high mass region but, when 
combined with the isT* (892) tail, yields too few events 
in the 1.1-1.3 GeV/c^ range (Fig. |(b)). This suggests 
a significant iS-wave contribution, in which case the re- 
coil J/-0 has a hehcity angle distribution ~ sin^(0j/^). 
The observed behavior (Fig. ||(c)) agrees with this con- 
jecture. This, together with the absence of ^-wave above 
1.5 GeV/c^, is consistent with the mass dependence of the 
S-wave K-K scattering amplitude [^ . If the K-k S-wave 
in B decay behaves like this, a coherent 5'- wave ampli- 
tude should also be present in the K*{892) region; S-P 
interference should occur, which, if ignored, can affect 
the P-wave amplitudes extracted from the data. 

The effect of 5*- wave in the K*{892) region has been es- 
timated by including a scalar term in the total amplitude. 
This yields a more complicated angular distribution gs, 
with ten fi functions. A fit of gs to the data in the 1.1- 
1.3 GeV/c^ region yields an S-wave fraction of (62 ± 9)%, 
in agreement with the failure of a P- and D-wave fit to 
describe the mass spectrum. Repeating the analysis us- 
ing gs, we find the S-wave contribution in the K*{892) 
region to be (1.2 ± 0.7)%. The differences in the P-wave 
results with and without 5'-wave are taken as estimates 



of systematic uncertainty (Table [I], fourth row) since, 
with the present statistics, the presence of S-wave in the 
/'ir*(892) region cannot be confirmed. 

Table IV compares our results to those of CLEO ||] 
and CDF M. They are consistent, but the present mea- 
surement is significantly more precise. Longitudinal po- 
larization is seen to dominate and the P-wave intensity 
is small. If sin2/3 were measured in the B -^ J/i/jK'^tt'^ 
channel from the decay-time information only, the value 



of the dilution from the present measurement, _Dj 
0.68 ± 0.07, would contribute a 10% uncertainty. 



TABLE IV: Comparison with other experiments. Statistical 
and systematic uncertainties are added in quadrature. 



CLEO 
CDF U 



\M 



\Aa 



0.52 ±0.08 0.16 ±0.09 
0.59 ±0.06 0.13t;]}? 



-0.11 ±0.46 3.00 ±0.37 
-0.56 ±0.54 2.16 ±0.47 



BABAR 0.60 ± 0.04 0.16 ± 0.03 -0.17 ± 0.17 2.50 ± 0.22 



Finally, we find that \(J)h\ differs significantly from n. 
This agrees with the CDF measurement, and indicates 
a departure from the factorization of the hadronic cur- 
rents. In addition, there is evidence that S- and D-wave 
amplitude contributions are necessary for a description 
of the Kt: mass spectrum from B ~^ J/ip Kn decay. 
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